Neural statics and dynamics

نویسنده

  • Robert L. Fry
چکیده

A formal theory of systems was proposed previously as providing a quantitative basis for neural computation. This theory dictated the architectural aspects of a pyramidal-neuron system model including its operation, adaptation, and most importantly, its computational objective. The principal result was a perceptron architecture that, through adaptation, learns to ask a specific space–time question answered by a subset of the space–time binary codes that it can observe. Each code is rendered biologically by spatial and temporal arrangement of action potentials. Decisions made whether the learned question is answered or not are based on a logarithmic form of Bayes’ Theorem which induces the need for a linear weighted superposition of induced synaptic effects. The computational objective of the system is simply to maximize its information throughput. The present paper completes prior work by formalizing the Hamiltonian for the single-neuron system and by providing an expression for its partition function. Besides explaining previous work, new findings suggest the presence of a computational temperature T above which the system must operate to avoid ‘‘freezing’’ upon which useful computation becomes impossible. T serves at least two important functions: (1) it provides a computational degree of freedom to the neuron enabling the realization of probabilistic Bayesian decisioning, and (2) it can be varied by the neuron so as to maximize its throughput capacity in the presence of measurement noise. r 2004 Elsevier B.V. All rights reserved.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Statistical Mechanics of Recurrent Neural Networks II. Dynamics

A lecture notes style review of the non-equilibrium statistical mechanics of recurrent neural networks with discrete and continuous neurons (e.g. Ising, graded-response, coupled-oscillators). To be published in the Handbook of Biological Physics (North-Holland). Accompanied by a similar review (part I) dealing with the statics.

متن کامل

2 00 4 Asymmetrically extremely dilute neural networks with non - trivial dynamics

We study graded response attractor neural networks with asymmetrically extremely dilute interactions and Langevin dynamics. We solve our model in the thermodynamic limit using generating functional analysis, and find (in contrast to the binary neurons case) that even in statics one cannot eliminate the non-persistent order parameters. The macroscopic dynamics is driven by the (non-trivial) join...

متن کامل

2 00 6 From urn models to zero - range processes : statics and dynamics

The aim of these lecture notes is a description of the statics and dynamics of zero-range processes and related models. After revisiting some conceptual aspects of the subject, emphasis is then put on the study of the class of zero-range processes for which a condensation transition arises. From urn models to zero-range processes: statics and dynamics 2 Introduction

متن کامل

System Dynamics and Artificial Neural Network Integration: A Tool to Valuate the Level of Job Satisfaction in Services

Job Satisfaction (JS) plays important role as a competitive advantage in organizations especially in helth industry. Recruitment and retention of human resources are persistent problems associated with this field. Most of the researchs have focused on the job satisfaction factors and few of researches have noticed about its effects on productivity. However, little researchs have focused on the ...

متن کامل

Reinventing the Teaching of Statics

Learning in the subject of Engineering Statics deserves significant attention. First, Statics lays the foundation for subsequent courses, namely Dynamics and Strength of Materials, both of which rely heavily on free body diagrams and on recognizing the combined effect of forces. While there are new ideas which are emphasized in engineering dynamics, instructors in this subject inevitably find t...

متن کامل

Asymmetrically extremely dilute neural networks with Langevin dynamics and unconventional results

We study graded response attractor neural networks with asymmetrically extremely dilute interactions and Langevin dynamics. We solve our model in the thermodynamic limit using generating functional analysis, and find (in contrast to the binary neurons case) that even in statics, for T > 0 or large α, one cannot eliminate the non-persistent order parameters, atypically for recurrent neural netwo...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Neurocomputing

دوره 65-66  شماره 

صفحات  -

تاریخ انتشار 2005